Content Validity of the Rodeo-SCAT

Abstract

The purpose of this study was to establish the content validity of the Rodeo SCAT for the sport of rodeo and bull riding. The study design was comprised of expert consensus and content validation. A modified Ebel procedure was employed to content validate the rodeo SCAT. Content validation using this method includes experts agreeing on the importance of each item that comprises the rodeo SCAT. This 3-stage process involved: 1) face validation by a local committee: 2) initial expert consensus measurement via distance; and 3) a face-to-face discussion for items that did not originally achieve 80% consensus of the group. Experts were chosen from the Canadian Professional Rodeo Sport Medicine Team (Canada) and the Justin Sports Medicine Team (USA). 27 out of a total possible 68 items achieved 80% consensus in the second stage. In the third stage, 4 of the 68 items were removed with consensus from the expert group. All remaining items achieved 80% consensus for inclusion. In summary, the rodeo SCAT is content valid and thus, appropriate for use in the sport of rodeo context or environment.

Key words

content validation - concussion evaluation - SCAT - rodeo

• References

• 1 Alla S, Sullivan SJ, Hale L, McCrory P. Self-report scales/checklists for the measurement of concussion symptoms: a systematic review. Br J Sports Med 2009; 43 (suppl 1) i3-i12
• 2 Arnheim D, Prentice W. Principles of Athletic Training. New York: McGraw Hill; 2000
• 3 Aubry M, Cantu R, Dvorak J, Graf-Bauman T, Johnston K, Kelly J, Lovell M, McCrory P, Meeuwisse WH, Schamasch M. Summary and Agreement Statement of the 1st International Symposium on Concussion in Sport, Vienna, 2001. Clin J Sport Med 2002; 12: 6-11
• 4 Brandenburg MA, Butterwick DJ, Hiemstra LA, Nebergall R, Laird J. A comparison of injury rates in organized sports with special emphasis on American bull riding. Int Sportmed J 2007; 8: 78-86
• 5 Butterwick DJ, Hagel B, Nelson DS, Lafave MR, Meeuwisse WH. Epidemiologic analysis of injury in five years of Canadian professional rodeo. Am J Sports Med 2002; 30: 193-198
• 6 Cantor J. A validation of Ebel’s method for performance standard setting through its application with comparison approaches to a selected criterion-referenced test. Educ Psychol Meas 1989; 49: 709-721
• 7 Cantu R. Guidelines for return to sports after a cerebral concussion. Physician Sportsmed 1986; 14: 75-83
• 8 Collins M, Grindel S, Lovell M, Dede D, Moser D, Phalin B, Nogle S, Wasik M, Cordry D, Daugherty M, Sears S, Nicolette G, Indelicato P, McKeag D. Relationship between concussion and neuropsychological performance in college football players. JAMA 1999; 282: 964-970
• 9 Colorado Medical Society . The School of Health and Sports Medicine Committee Guidelines for the Management of Concussion in Sport 1994; 10-16
• 10 DeVellis R. Scale Development: Theory and Applications. Thousand Oaks: Sage Publications; 2003
• 11 Eckner JT, Kutcher JS. Concussion Symptom Scales and Sideline Assessment Tools: A Critical Literature Update. Current Sports Medicine Reports 2010; 9: 8-15
• 12 Gennarelli T, Torg J In: Torg JS, Shephard RJ. eds. Current Therapy in Sports Medicine: Closed Head Injuries. St. Louis: Mosby; 1995
• 13 Gioia GA, Isquith PK, Schneider JC, Vaughan CG. New approaches to assessment and monitoring of concussion in children. Top Lang Disord 2009; 29: 266-281
• 14 Grindel S, Lovell M, Collins M. The assessment of sport-related concussion: The evidence behind neuropsychological testing and management. Clin J Sport Med 2001; 11: 134-143
• 15 Hodges B. Validity and the OSCE. Med Teach 2003; 25: 250-254
• 16 Hugenholtz H, Richard M. Return to athletic competition following concussion. Can Med Assoc J 1982; 127: 827-829
• 17 Jordan B, Tsairis P, Warren R. Sports Neurology. Rockville: Aspen; 1989
• 18 Kelly J, Rosenberg J. Diagnosis and management of concussion in sports. Neurology 1997; 48: 575-580
• 19 Kelly J, Rosenberg J. The development of guidelines for the management of concussion. J Head Trauma Rehab 1998; 13: 53-65
• 20 Kuland D. The Injured Athlete. Lippincott; 1982
• 21 Lafave L, Lafave MR. The Versatility of the Ebel Method for Content Validation. 25 Ottawa Conference Proceeding 2010;
• 22 Lafave M, Katz L, Butterwick D. Development of a content-valid standardized orthopedic assessment tool (SOAT). Adv Health Sci Educ Theory Pract 2008; 13: 397-406
• 23 Lafave M. Does the Glasgow Coma Scale belong in the SCAT 2? Yes, but. Clin J Sport Med 2009; 19: 512
• 24 Lynn M. Determination and Quantification of Content Validity. Nursing Research 1986; 382-385
• 25 Maddocks D, Dicker G, Saling M. The assessment of orientation following concussion in athletes. Clin J Sport Med 1995; 5: 32-35
• 26 McCrea M, Kelly JPM, Kluge J, Ackley B, Randolph C. Standardized assessment of concussion in football players. Neurology 1997; 48: 586-588
• 27 McCrory P, Johnston K, Meeuwisse W, Aubry M, Cantu R, Dvorak J, Graf-Baumann T, Kelly J, Lovell M, Schamasch P. Summary and Agreement Statement of the 2nd International Conference on Concussion in Sport, Prauge 2004. Br J Sports Med 2005; 39: 196-204
• 28 McCrory P, Meeuwisse WH, Johnston K, Dvorak J, Aubry M, Molloy M, Cantu R. Consensus Statement on Concussion in Sport. 3rd International Conference on Concussion in Sport Held in Zurich, November 2008. Clin J Sport Med 2009; 185-200
• 29 Meyers MC, Elledge JR, Sterling JC, Tolson H. Injuries in intercollegiate rodeo athletes. Am J Sports Med 1990; 18: 87-91
• 30 Meyers MC, Laurent CM. The Rodeo Athlete: Injuries – Part II. Sports Med 2010; 40: 817-839
• 31 Nelson W, Jane J, Geick J. Minor head injury in sports: A new system of classification. Physician Sports Med 1984; 12: 103-107
• 32 Ommaya A, Gennarelli T. Cerebral concussion and traumatic unconciousness: correlation of experimental and clinical observations on blunt head injuries. Brain 1974; 97-104
• 33 Ommaya A, Salazar A. A spectrum of mild head injuries in sport. In: National Athletic Trainers’ Association. Proceedings of Mild Brain Injury in Sports Summit. Dallas: 1994: 72-80
• 34 Portney L, Watkins M. Foundations of Clinical Research: Applications to Practice. Upper Saddle River New Jersey: Pearson Prentice Hall; 2009
• 35 Ptito A, Chen J, Johnston K. Contributions of functional magnetic resonance imaging (fMRI) to sport concussion. NeuroRehabilitation 2007; 22: 217-227
• 36 Saal J. Common American football injuries. Sports Med 1991; 12: 132
• 37 Torg J. Athletic Injuries to the Head, Neck and Face. St. Louis: Mosby; 1991
• 38 Wilberger JE, Maroon JC. Head injuries in athletes. Clin Sports Med 1989; 8: 1-9
• 39 Young C, Jacobs B, Clavette K, Mark D, Guse C. Serial sevens: Not the most effective test of mental status in high school athletes. Clin J Sport Med 1997; 7: 196-198